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THESIS DISCLAIMER 



The reader is cautioned that computer programs developed in this research may 
not have been exercised for all cases of interest. While every effort has been made, 
within the time available, to ensure that the programs are free of computational and 
logic errors, they cannot be considered validated. Any application of these programs 
without additional verification is at the risk of the user. 
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I. INTRODUCTION 



A. BACKGROUND 

1. A Carrier Navy 

The carrier is the nucleus of today's U.S. Navy, but its ability to project power 
is a byproduct of the synergistic relationship it shares with its air wing. As Peter 
Garrison stated in CV: Carrier Aviation, "by adopting submarine-launched ballistic 
missiles and ship-based tactical aircraft the navy has co-opted some of the tools of the 
army and air force and adapted them to a marine environment. Ships in themselves are 
no longer powerful, they take their power from the airplanes or long range missiles that 
they carry'. An adversary setting out to sink a ship does not send another ship against 
it, but instead sends an airplane or a missile" [Ref. 1]. (italics mine). The fleet has 
become dependent upon aircraft to take the battle over the horizon, and to extend the 
battle group's area of influence. Without downplaying the importance of the carrier, it 
is just another large ship without its contingent of aircraft. • Thus, the carrier's real 
importance to the fleet rests on the ability of its personnel to support and maintain the 
air wing at an optimal level of readiness. 

2. Aircraft Readiness 

Ideally, the fleet would like each aircraft to be fully mission capable (FMC); 
that is, the material condition of the aircraft should satisfy minimum requirements to 
perform all of its missions. An aircraft's mission status (e.g., partially mission capable 
(PMC), not mission capable (XMC), etc.) is determined using the Mission Essential 
Subsystems Matrices published in OPNAVINST 5442. 4H. 

The ability to ensure a high percentage of FMC aircraft is constrained by 
several factors. First, the Navy has not been able to. provide shipboard intermediate 
maintenance activities (IMA) with sufficient numbers of qualified personnel, especially 
in critical technical billets. In part, this results from the allocation of manpower based 
on squadron size (i.e., the smaller squadrons have fewer personnel to maintain their 
aircraft). The problem associated with the manpower shortage is compounded by a 
need for specialization in troubleshooting and repairing the different aircraft types, 
models, and series deployed on the carrier. Second, the IMA's capability to repair 
components as they fail is constrained by limitations of test equipment, maintenance 
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facility size, availability of repair parts, and the total demand within the repair pipeline. 
Finally, those components which cannot be fixed at the intermediate level must be 
resupplied by outside sources. 

The air wing must be able to accurately identify and communicate its 
requirements for component replacements and resupply facilities should be capable of 
expeditiously responding to the those needs. During periods of high tempo flight 
operations, as would be experienced during wartime, the factors listed above become 
more critical. The ability to maintain high levels of readiness is hampered by an 
increase in the number of components in the repair pipeline, manpower and facility 
limitations, and a reduced or nonexistent ability 'to resupply vital components. 
Potential problems may be partially rectified by improving the methodologies currently 
used to attain that "best" possible mix of replacement parts located on the aircraft 
carrier. [Ref. 2: pp. 3.9] 

B. AVIATION CONSOLIDATED ALLOWANCES 

1. Definition 

The Aviation Consolidated Allowance List (AVCAL) is supposed to be a 
"best" mix inventory. An AVCAL is defined in OPNAVINST 4790.2C as a list of 
aeronautical material tailored to each individual ship to support assigned or embarked 
aircraft flight operations. This list of parts is prepared by the Navy's Aviation Supply 
Office (ASO) under the direction of the aircraft type commander, and determines spare 
part allowances based on expected demands. 

Ideally, it would be advantageous to stock at least one spare for each part 
that could possibly fail during deployment regardless of how unlikely that occurrence 
might be. Unfortunately, inventory sizes are constrained by both budget 
considerations and storage limitations. The latter is the result of a diverse collection of 
aircraft types, manufactured by different companies with each aircraft requiring its own 
specific replacement parts, coupled with the inherent aversion to building aircraft 
carriers even larger than they already are simply to carry more parts. Table 1 lists the 
normal complement of aircraft aboard a carrier, and is provided to illustrate the 
differences in aircraft types, missions, and spare part requirements. [Ref. 2: p.5]. 

2. Need for Improvement 

Determination of the proper AVCAL allowance for each component is not an 
easy task, and is definitely an area needing improvement. A recent study conducted by 
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TABLE 1 

NORMAL COMPLEMENT OF CARRIER AIRCRAFT 



AIRCRAFT 


MISSION 


SQUADRONS 


AIRCRAFT 


F-14A 


Fighter 


2 


24 


A-7E 


Light Attack 


2 


24 


A-6E 


Attack 


1 


10 


KA-6D 


Tanker 


1 


4 


S-3A 


ASW 


1 


10 


E-2C 


SURV 


1 


4 


EA-6B 


EW 


1 


4 


SH-3 


ASW 


1 


6 


TOTAL 






81 



the Center for Naval Analyses reported that "statistics for combat aircraft operating 
during the period July 1982 through June 19S3 show aircraft operating at less than 60 
percent of their anticipated wartime rate. These aircraft were not F.V1C due to supply 
between 18-24 percent of the time. These readiness rates would drop significantly if the 
aircraft Hew at a wartime rate and AVCALs continued to be constructed as they were 
in this period" [Ref. 3: p.1-1]. This statement strengthens the argument that current 
methods of AVCAL formulation are, at best, adequate for peacetime operations, but 
could result in disastrously low readiness rates when exposed to the additional 
requirements associated with wartime utilization. Two approaches to determining a 
better AVCAL would be the introduction of new methods of modelling requirements or 
the improvement of weak areas within the current model. 

3. AVCAL Models 

Two categories of models used to compute the AVCAL are readiness-based 
and demand-based inventory systems. Readiness-based systems determine spare 
allowances that achieve a predetermined level of readiness while minimizing the cost of 
the AVCAL. Examples of readiness-based models are Rand's DYNAMETRIC model 
and the Center for Naval Analyses' MIME model [Ref. 3: p.2-S]. Demand-based 
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(supply effectiveness) models determine component allowances based on expected 
demand and the capabilities of the repair facility and resupply pipeline. The ASO 
Manual model is an example of a demand-based method, and is the model currently 
used by the Navy to compute AVCAL spare allowances. 

C. ASO MANUAL MODEL 

The ASO Manual Model uses historic data to forecast demand rates and 
component repair times. The model determines the type and number of components 
included in the AVCAL allowance. For a detailed explanation of the rules governing 
component selection, the reader should refer to either Aviation Parts Allowance Policy 
by Peter Evanovich or A Retail Inventory Model for Naval Aviation Repairable Items by 
Mark L. Mitchell. [Refs. 3,4], 

1. Attrition Only Items 

Attrition only items are repairable components that cannot be repaired at the 
intermediate maintenance activity aboard the carrier. The expected demand for items 
of this type is computed using equation 1.1. 

NB' = NB x ( FH7FH) (eqn 1.1) 



where, 

NB' = number of expected attritions for a specific flight program 
NB — number of attritions in the ASO data base 
FH' = specified flight program 

FH = total flight hours represented by the ASO data base 
2. Items that can be Repaired Locally 

The allowance for items that can be repaired locally is composed of two parts. 
An allowance for repairable components that are beyond the capabilities of the local 
maintenance activity to repair them (BCM), and an allowance for components that are 
queued at various places in the local repair cycle. 
a. BCM Allowance 

Units are considered BCM if the maintenance activity cannot repair the 
item because of a lack of tools, equipment, parts or technical expertise. Equation l.l is 
used to forecast the number of BCM failures expected to occur for a specific flight 
program. 
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b. Repair Pipeline Allowance 

The second input to the local repairable allowance provides units to 
compensate for the number of failed components undergoing repair at the IMA. This 
allowance, called the Local Repair Cycle Allowance (LRCA), is set at a quantity which 
should ensure that demand does not exceed available supply at least ninety percent of 
the time. This safety level is dependent upon an accurate estimate of the number of 
components repaired by the shipboard intermediate maintenance activity. Such a 
forecast is expressed in equation 1.2. 

NR' = N T R* (FH'/FH) (eqn 1.2) 



where, 

NR' = number of expected repairs for a specific flight program 
NR = number of repairs represented in the ASO data base 
and, 

. FH' and FH remain as defined above 

D. FAILURE RATE DISTRIBUTION 

Combining equations 1.1 and 1.2 provides the expected number of total failures, 
both repairables and attritables, for the specified flight program. 1 

NR' + NB' = (NR + NB) * (FH'/FH) (eqn 1.4) 

Substituting N’F' for NR' + NB' and NT for NR + NB, equation 1.4 can be expressed 
as: 



NF’ = NF x (FH'/FH) (eqn 1.5) 

Equation 1.6 results from rearranging terms on the right hand side of equation 1.5. 

NF' = (NF/FH) x FH' (eqn 1.6) 



^or "attrition only items" NR' equals zero. 
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The total number of expected failures NF' equals the product of some specific 
future flight program (FH') and the quantity NF/FH. The latter should be easily 
recognized as the maximum likelihood estimate (based on the historical data base) for 
the failure rate lambda. Thus, NF' is the expected value of a Poisson distribution with 
the failure rate parameter X and interval of observation (0,FH']. The use of the Poisson 
distribution implies that the underlying distribution for the time between failures is 
exponential. Certain properties of the exponential distribution simplify the 
computational problem, but what price is paid for this simplicity? The remainder of 
this paper w’ill suggest alternative distributions for describing the time between 
component failures and estimating the expected number of failures for a given flight 
program. 

E. SYNOPSIS 

Chapter II describes the methods and assumptions used to extract component 
failure information from a data base containing six squadrons of F-14A aircraft flight 
and maintenance records. Chapters III and IV discuss current and possible methods 
of modeling aircraft failure rates, and techniques used to derive maximum likelihood 
estimates of model parameters. Flight hour dependent models are presented in Chapter 
III and include the traditional Exponential model and a Weibull model. Chapter IV 
discusses a sortie-dependent Geometric model, and the sortie-flight hour Mixed model 
proposed in Distinguishing the Effects on Failures of Changes in Sortie Rate and Sortie 
Length by Robert A. Levy [Ref. 5]. The four different models will be compared in 
Chapter V using both graphical and quantitative measures of fit. Finally, Chapter VI 
will discuss the advantages and disadvantages of each model, along with the 
conclusions and recommendations. 
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II. DATA BASE 



A. ORIGIN OF DATA 

The initial data base was obtained from the Navy Maintenance Support OlFice 
(XMSO), Mechanicsburg, Pennsylvania via the Center for Naval Analyses. Alexandria, 
Virginia. The data set included the historical flight and maintenance records for two 
operational deployments of F-14A aircraft. The most recent deployment included two 
squadrons, VF-114 and VF-213, which operated off the USS ENTERPRISE (CVN-65) 
during the period of March 19S4 through December 1984. This deployment became the 
"model" set, with its flight and maintenance records providing the parameter estimates, 
for the study. 

The second, earlier deployment consisted of four squadrons, VF-11 VF-31 and 
VF-14/VF-32, which operated off the USS KENNEDY (CV-67) and USS 
INDEPENDENCE (CV-62), respectively, during the period of November 19S3 through 
March' 19S4. In this study these four squadrons were treated as the "validation" set. 

Using the parameter estimates from the model set, four specific failure rate 
distributions were used to calculate the expected number of component failures which 
should occur during a deployment similar to the one flown by the four squadrons 
aboard the USS KENNEDY and USS INDEPENDENCE. The actual number of 
component failures observed during the deployment of these squadrons was then 
compared with the expected number generated using the parameters estimated from the 
"model" set deployment. 

B. MAINTENANCE DATA SYSTEM (MDS) 

1. Purpose 

The maintenance data system (MDS) was developed to improve the 
management capabilities of the Navy's Maintenance and Material Management (3-M) 
system. It was designed as a management information system which would provide the 
statistical data needed to analyze: 

• Equipment maintainability and reliability 

• Equipment configuration to include alterations and technical directive 
compliance 

• Equipment mission capability and utilization rates 

• Material usage 
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• Maintenance and material procurement times 

• Weapon system and material costing 

To meet the data requirements listed above, NMSO divides the data collection 
effort into four specific areas: material reporting (MR), subsystem capability impact 
reporting (SCIR), maintenance data reporting (MDR), and utilization reporting. The 
material reporting system documents those materials used in support of the 
maintenance efforts. The subsystem capability impact report provides the higher level 
commanders with information pertaining to their subordinate command's ability to 
conduct their mission. The last two areas of data collection, maintenance data 
reporting and utilization reporting, provided the data necessary' to determine the times 
between component failures. 

2. Maintenance Data Reporting (MDR) 

The documents which support the maintenance data reporting system include 
support action forms (SAF), metrology equipment recall (METER) cards, and the 
Visual Information Display System/ Maintenance Action Forms (VIDS MAF). Support 
action forms document maintenance actions that did not require any corrective action, 
such as, aircraft servicing, aircraft handling, gnd the preliminary look phase of an 
inspection. METER cards identify the maintenance time spent calibrating, and repairing 
the test and measuring systems. The last form. VIDS/MAF (OPNAV 4790/60). 
documents inspections, technical directive compliance, and repair actions. It identifies 
the component failures by work unit code, time of failure (julian date and. when 
discovered code), aircraft experiencing the failure (bureau number), cause of failure 
(malfunction description code), and type of maintenance required (transaction code and 
action taken code). 

3. Utilization Reporting 

The flight records (utilization rates) were compiled from information recorded 
on the Aircraft Yellow Sheet (OPNAV 3760/2B). The Yellow Sheet is prepared by air 
crew personnel at the end of each mission and contains information identifying the 
flight according to aircraft flown, mission type, julian date, flight duration, etc. 

C. SELECTED WORK UNIT CODES 

A work unit code (WUC) is an alphanumeric code identifying an item on which 
work is being performed. Systems are identified with two digit codes and components 
with five digit codes. Seven digit codes are used to further breakdown components into 
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lower levels of subassembly. The components selected for this study are listed in 
Table 2. Each of the nine components chosen had at least thirty failures during the 
deployment cycle. 



D. DATA REDUCTION 

The intent of the data reduction process is to eliminate those maintenance 
actions which do not identify a component failure (e.g.. aircraft servicing, 
troubleshooting, calibrations, or other routine maintenance actions). The maintenance 
codes not indicative of a component, item failure are found within the series of 
malfunction description, transaction, and action taken codes. [Ref. 6: pp. 17-19] 

1. Malfunction Description Codes 

The three digit numeric malfunction description codes describe, as accurately 
as possible, the probable cause of a system/component failure. Malfunction 
description codes used when no failure was detected are displayed in Table 3. 
Maintenance records which contained these codes were eliminated from the final data 
set. Conditional malfunction description codes identify component failures caused by 
factors other than natural wear-out. Examples of this type of failure include: failed due 



TABLE 2 

COMPONENTS WITH ASSOCIATED WORK UNIT CODES 



COMPONENT 

CN1263/ASN92(V) INERTIAL MEASURING UNIT 
ECU74/A SIGNAL DATA CONVERTER 
MXU611/A FUEL TANK RELEASE MECHANISM 
CPI 166/A AIR DATA COMPUTER 
AN/ARC 159/ 159( V)- 1 UHF TRANSMITTER 
T1224/AWG9 RADAR TRANSMITTER 
IP1 185/AWG9 DETAIL DATA DISPLAY 
CP124S/ASW43 AIRCRAFT ROLL COMPUTER 
IP1027/AVA12 ANALOG DISPLAY INDICATOR 



734H100 

46X1600 

4622100 

56X2500 

632Z100 

74A1500 

74A5M00 

5772200 

69 1 S 100 



WUC 
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to weather, foreign object damage (FOD), improper or faulty maintenance, etc. To 
reduce the complexity of parameter estimation, conditional failures were treated as if 
the failure had occurred through normal usage. The components studied had a low 
percentage of conditional failures. In fact, less than three percent of all observed 
failures were conditional. 



TABLE 3 

EXCLUDED MALFUNCTION DESCRIPTION CODES 



CODE DESCRIPTION 

799 <• No defect 

800 No defect - removed and/or reinstalled to facilitate' maintenance 

801 No defect - removed for modification • 

803 No defect - removed for time change 

804 No defect - removed for scheduled “maintenance 

805 No defect - removed for pool stock 

806 No defect - removed as part of a matched svstem 

807 No defect - removal directed bv higher authority 

811 No defect - removed during troubleshooting 



2. Transaction Codes 

Transaction codes are two digit numeric codes used to identify the type of 
data reported by the maintenance activity. Transaction codes used in the maintenance 
reporting system are listed in Appendix A. Table 4 lists those transaction codes 
indicative of maintenance actions that required removal, installation, and/or repair of a 
defective component. Maintenance records associated with these codes were included in 
the final data set. All other maintenance records were deleted. 

3. Action Taken Codes 

Action taken codes are one digit alphanumeric codes which describe the 
maintenance action performed on the system, component or item. A complete list of 
action taken codes is shown in Appendix B. Action taken codes associated with the 
removal, installation, and/or repair of a defective component were included in the final 
data set and are shown in Table 5. 
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TABLE 4 




TRANSACTION CODES USED IN STUDY 


CODE 


DESCRIPTION 


12 


On-equipment work, including engines, involving non- 
repayable components/items documented as failed parts. 


21 


Will be used when a repairable component is removed, 
excluding engine components, for processing at an I or D 
level maintenance activity (This code is used when 
only the removal must be documented and a replacement 
is not required). 


23 

€* 


Removal and replacement of a defective or suspected 
defective component from an end item, excluding engines 
at the O-level. Additionally’ this code is used for” the~ 
removal and replacement of a complete engine assembly 
for a defect, suspected defect, or scneduled~maintenance 
requirement. 


24 


Will be used when a repairable engine component 
is removed for processing at an I or D level activity 
(This code is used when only the removal must be' 
documented and a replacement is not required). 


25 


Removal and replacement of a defective or suspected 
defective repairable component from an 'engine. 



E. FINAL DATA SET 
1. Problems 

Several problems were encountered during the data reduction process that 
require discussion. First, it was not always clear which flight evolution caused a 
component to fail. The cause for this confusion is the poor record keeping associated 
with the actual time of component failures. For example, the maintenance data 
reporting system does not record the actual time of component failure. Instead, the 
data is arranged according to the time the maintenance activity received the component 
for repair. In most, but not all cases, the component was received by the maintenance 
activity immediately following the flight causing the component failure. 

Second, several records indicated multiple failures of a single component. For 
example, a single component may experience several unrelated malfunctions during a 
single flight evolution. To expedite the repair and or replacement of the failed 
component, the maintenance reporting system requires the documentation of each 
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TABLE 5 

ACTION TAKEN CODES 



CODE DESCRIPTION 



1 BCM - maintenance activity not authorized to conduct 

repair 

.2 BCM - Lack of equipment, tools, or facilities 

3 BCM - Lack of technical skills necessary' to complete 
repair 

4 BCM - Lack of parts 

5 BCM - Fails check and test, and maintenance is allowed 
to conduct check and test only 

6 BCM - Lack of technical data 

7 BCM - Beyond the authorized repair depth 

S BCM - Administrative 

9 BCM - Condemned, repair not feasible 

C This code is used when a repairable iiem of material 

identified by a work unit code is repaired. 

F Failure of components items undergoing test. 

P This code is entered when an item of material is 

removed and only the removal is to be accounted for. 

Q This code is entered when an item is installed and 

only the installation action is to be accounted for. 

R This code is entered when an item of material is 

removed due to suspected malfunction and the same or a 
like item is reinstalled. 

* BCM: Action taken codes labelled 1-9 are used for repairable 

items which have been administratively and or technicallv screened 

and found to be bevond the capabilitv of the maintenance activitv. 



malfunction (i.e., multiple failures of a single component). Previous studies have 
treated this problem as independent single component failures with identical 
interoccurrence times. The alternative is to treat the multiple failure as a single 
incident. 

Third, the underlying assumption of the exponential distribution is that 
components fail as a function of flight hours flown. This would imply that a 
component is operated continuously, which may or may not be the case. 



Fourth, it was difficult to determine if a component was replaced immediately 
following the flight evolution causing the failure. Additionally, there was some concern 
pertaining to periods of flight operations during which a component might be missing. 

Fifth, the condition of the component (i.e., new or used) at the start of 
deployment was not always known. A related problem involves the use of the same 
failure rate distribution for both repaired and new components. 

2. Simplifying Assumptions 

Before proceeding with any data analysis, it is necessary to make assumptions 
which can simplify or eliminate the problems discussed in the previous section. These 
assumptions are presented in the same order as the problem areas they are intended to 
simplify. 

First, all failures are associated with the sortie during which they occurred for 
When Discovered Codes A, B, C. and D. For all other codes, it is assumed that the 
training and experience of the flight and ground crews ensure the discovery of the 
failure at the earliest- possible opportunity (i.e., the failure occurred during the flight 
prior to discovery). A complete listing of When Discovered Codes is found in 
Appendix C. 

Second, all multiple failures of a single component are treated as a single 
component failure. It is believed that multiple failures would affect the turnaround 
time required to repair the component and may cause delays within the repair pipeline. 
However, this should not affect the rate at which the component fails. 

Third, it is assumed that components operate continuously, at least in a 
standby mode. If this is not the case, the sortie-dependent models should provide a 
better estimate of expected failures. 

Fourth, the study assumes that components are replaced immediately and that 
gaps in coverage are not allowed. In fact, it is extremely unlikely that an aircraft 
would operate without any of the components listed in this thesis. 

Fifth, all components are considered new at the start of the deployment. For 
the Exponential and Geometric models this assumption is not necessary due to the 
"memoryless property" they exhibit. Additionally, the impact on the Weibull 
distribution should be minimal if the number of observed failures is large. 

Finally, to reduce the complexity of the problem, it is necessary to assume 
that repaired components exhibit the same failure characteristics as new components 
(i.e., have the same failure rate). 
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3. Format 

a. Parameter Estimation 

To obtain the best possible estimate of the time between failures, the 
observations within the initial data base were sorted by aircraft bureau number, then 
Julian date and the event time. Failure times were measured between consecutive 
component failures on a specific aircraft. These measurements were never made 
between component failures on two different aircraft. The information included in the 
final data set is the aggregate totals and includes a censoring indicator, number of 
sorties flown, flight time without failure, and flight time with failure. 

A censor indicator equal to zero indicates that a component failure was 
observed. The data entries associated with this type of observation include the number 
of flights flown inclusive of the event causing the failure, total flight time flown since 
last failure (does not include flight time of event causing failure), and the (light time of 
the event causing the failure. 

A censor indicator equal to one represents an event which is right hand 
censored. Right hand censoring refers to an observation of a component which does 
not fail prior to the termination of the deployment (i.e., the data set documents a 
component's survival time, but provides no information pertaining to the actual time of 
component failure). The data entries associated with this type of observation are the 
total number of flights flown and the total flight time since the last component failure. 

b. Model Compar ison 

The intent of this thesis is to determine each model's ability to predict 
failures for the' components listed, and compare those predictions with the actual 
component failures observed during the deployment of the squadrons aboard the 
L’SS KENNEDY and USS INDEPENDENCE. To accurately assess these capabilities, 
it was necessary to identify component failures as they occurred during the deployment. 
Thus, the data set used to provide the graphical and quantitative comparison of the 
predicted vs actual component failures was different than the data set used to estimate 
the model parameters. The latter data set was sorted by Julian date and event time 
only. The accumulated number of sorties flown and flight hour totals were recorded 
with the observation of each failure, such that, comparisons could be made with the 
expected failures generated by the failure rate models. 
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4. Summary Statistics 

Table 6 summarizes the two data sets and provides such information as the 
number of aircraft assigned, sorties flown, flight hour totals, component failures, etc. 





TABLE 6 








SUMMARY STATISTICS 




DATA SET 


AIRCRAFT SORTIES 


FLT HRS/SORTIE 
FLT HRS MEAN STD. DEV. 


MODEL 


30 3489' 


7608.8 2.18 


.98 


VALIDATION 


44 3012 


7030.4 2.33 


.54 


WUC 


MODEL SET 
FAILURES 


VALIDATION SET 
FAILURES 




734H100 


105 


5S 




46X1600 


34 


49 




4622100 


49 


6 




56X2500 


85 


79 




632Z100 


49 


57 




74A1500 


107 


75 




74 A5 VI 00 


118 


104 


. 


5772200 , 


34 


33 




6918100 


81 


93 




MODEL SET = 


VF-114 and VF-213 






VALIDATION SET = VF-11, VF-14, VF-31, and VF-32 
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III. FLIGHT HOUR MODELS 



A. OVERVIEW 

The two models discussed in this chapter describe component failures as a 
function of flight hours only. The first flight hour model to be examined is the 
exponential, which is the model currently used by the Navy to describe the distribution 
of the time between component failures. This model has some weaknesses inherited 
from the properties of the exponential distribution. The effect these problem areas 
might have on the model's ability to accurately predict component failures will be 
discussed in the next section. The three models offered as alternatives should provide 
improvement to some or all of these problem areas, and the comparisons made in 
Chapter V should shed new light on the magnitude of these deficiencies. 

The second flight hour model discussed is the Weibull. It is offered as an 
alternative method of describing the time between failures when flight hours are the 
only factors contributing to the component malfunction. 

B. EXPONENTIAL MODEL 

1. Weaknesses 

There are two major weaknesses associated with this model that cause some 
concern. First, the exponential is a flight hour model and as such it is insensitive to the 
effects of the sortie on the component's time of failure. In Chapter V it will be shown 
that the expected number of component failures for the time interval (O.t] is 
proportional to t, so that the expected number of failures for a specific flight hour total 
is not affected by the average sortie length (i.e., the number of sorties flown). 

Second, the exponential distributions are "NO WEAR" distributions, which 
indicates that a component's probability of surviving a flight of duration t is the same 
for new components as it is for components which are "S" hours old (i.e., the 
conditional survival probability is equal to the unconditional probability of survival). 
This is the "memoryless" property of the exponential distribution, and implies that the 
prior use of a component has no effect on the time of its failure. 

The same concern is reflected in the exponential distribution's constant hazard 
rate r(t) (i.e., r(t) = X for all values of t). As such, the failure rate X would not be 
affected by the time on test t. It is believed that certain components exhibit hazard 
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rates that are decreasing functions of time (t). In fact, many pieces of electronic 
equipment are routinely exposed to burn-in periods to make the component less 
susceptible to failure when put into operation. Conversely, it can be argued that other 
components have hazard rates that increase with time (i.e., a component is more likely 
to fail as it experiences some wear and tear). The exponential distribution is not 
capable of modelling these differences. 

2. Maximum Likelihood Results 

The maximum likelihood estimate, X', of the exponential failure rate 
parameter X (failures/hour) is found by iteratively solving equation 3.1r 

v -r r Tj,t: >0, X>0, m< n 

> T. = > - 1 — 1 — 1 J (eqn 3.1) 

i j l-exp(-Xt) i=l,2,...,n j=l,2,...,m 

where, the left hand side of equation 3.1 equals the aggregate flight time for those 
sorties that did not experience a specific component failure, tj is the duration of the 
sortie causing the failure, n is the total number of records, censored and uncensored, 
within the final data set, and m is the number of uncensored observations (failures). 

If the sortie lengths, tj, are equal to t for all j, then equation 3.1 can be 
simplified to the closed form expression given in equation 3.2. Thus, the average sortie 
length can be used to provide a "rough" estimate of the maximum likelihood estimator 
X': 



-ln( FTWF/TFT) 

X' = (eqn 3.2) 

where, FTWF (Flight Time Without Failure) equals the sum of the Tj's for i= l,...n, 
TFT equals the total flight time for the deployment, and t equals the average sortie 
length. 

The maximum likelihood estimate for X' was found using the FORTRAN 
program listed in Appendix E. The parameter estimates and 95 percent confidence 
limits for these estimates are displayed in Table 7. 



2 For the derivation of this maximum likelihood equation, the reader is referred to 
Appendix D. 
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TABLE 7 

EXPONENTIAL MAXIMUM LIKELIHOOD RESULTS 



wuc 


X' 


*X' 


CL X 


734H100 


.0140 


.0018 


(.0106..0175) 


46X1600 


.0048 


.0010 


(.0029..0067) 


4622100 


.0065 


.0011 


(.0043, .00S6) 


56X2500 


.0114 


.0021 


(.0073,.0155) 


632Z100 


.0067 


.0012 


(.0043, .0090) 


74A1500 


.0143 


.0019 


(.0105,-0181) 


74A5M00 


.0159 


.0024 ' 


(.0113,-0206) 


5772200 


.004 S 


.0011 


(.0026, .0070) 


69 IS 100 


.010S 


■ .0015 


(.0079, .0137) 



*** CL= 95 PERCENT CONFIDENCE LIMITS 



3. Quantile-Quantile Plots 

A graphical method often used to determine an empirical data's goodness of 
fit with respect to a theoretical distribution is the quantile-quantile plot. The technique 

requires the observations, Xj,X 2 X n , to be ordered from smallest to largest. 

Empirical quantiles are then computed for these order statistics based on a formula, 
such as Qj = (i-.5)/n, where Q ; is the empirical quantile for the X^ order statistic and n 
equals the total number of observations. These empirical quantiles are plotted against 
the theoretical quantiles to produce a graphical estimate of goodness of fit. 

Some adjustments to the above technique must be made to overcome the 
problems of censoring. The first adjustment relates to the problem associated with 
incomplete knowledge of the actual time of component failure. In Chapter II, it was 
mentioned that the failure occurred during the interval T to T + t. To simplify this 
problem, it is assumed that the midpoint of that interval represents the actual time of 
failure. 
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The second adjustment that needs to be made accounts for those observations 
that are right hand censored. The Kaplan-Meier method for quantile estimation will 
account for those observations and will provide a more accurate estimate for the 
empirical quantiles. This method also requires that each observation, censored and 
uncensored, be ordered from smallest to largest. The empirical quantiles (Q ; ) are 
computed using equation 3.3: 

Qj= l-[(n+.5)/n] n [(n-k+ .5)/(n-k+ 1.5)] for i in I (eqn 3.3) 

k in I 
k<i 

where, I is the set of all uncensored observations, and n is the total number of 
observations, censored and uncensored. [Ref. 7: p. 234] 

An exponential quantile-quantile plot was constructed for each of the nine 
components studied. The quantile-quantile plots for work unit codes 734H100 and 
56X2500 are displayed in Figures 3.1 and 3.2. and the remaining quantile-quantile plots 
are presented in Appendix F. The y-axis of the plot represents the quantiles, P(T < t), 
and the x-axis represents the time between component failures. The asterisks identify 
the uncensored observations, the x 's identify* the locations of the censored 
observations, and the theoretical distribution evaluated using X’ is defined by the solid 
line. The empirical data is fit well by the theoretical distribution if the data points are 
tightly packed around the solid line. Data points which deviate from the line can 
provide information about areas of weakness. ' 

Figure 3.1 illustrates the best exponential fit of all the quantile-quantile plots, 
but the plot still shows the lower to mid quantiles associated with the empirical data 
points overestimate the quantiles computed using the theoretical distribution. Figure 
3.2 provides a better representation of the other quantile-quantile plots. In every plot, 
the empirical quantiles overestimate the theoretical quantiles for quantiles less than .5, 
and underestimate the theoretical quantile for quantiles greater than .75. 

Figure 3.3 displays the Weibull cumulative distribution function for a equal to 
.5, 1, and 2. The reader should be aware that a Weibull distribution with shape 
parameter (a) equal to 1 is the exponential distribution. Figure 3.3 shows that for 
values of time less than t g , the cumulative distribution for the curve represented by 
a = .5 is greater than the exponential curve (a= 1), and for values of time greater than 
t g it is less than the cumulative distribution of the exponential curve. This is the 
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Figure 3.1 Exponential Quantile-Quantile Plot: WUC 734H100. 
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Figure 3.2 



Exponential Quantile-Quantile Plot: WUC 56X2500, 



identical situation displayed in each of the nine quantile-quantile plots. This would 
suggest that the distribution representing the time between component failures might 
be better modelled with a Weibull distribution with parameters, X>0 and 0^a< 1. 




Figure 3.3 Weibull Cumulative Distribution Function. 



C. WEIBULL MODEL 
1. Properties 

The next flight hour model that will be discussed is the Weibull distribution, 
which can be a viable alternative to the exponential distribution since it is capable of 
modelling many different failure rates. The major difference between the Weibull and 
Exponential models is that the former is usually not "memoryless", which indicates that 
the component's previous usage can be exploited in the determination of the expected 
failure time. 
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The two parameters associated with the Weibull distribution are the scale 
parameter (X) and the shape parameter (a), with each shape parameter defining a 
specific failure rate distribution. As such, the Weibull family of distributions has the 
capability to model many different types of component wear. For example, a values 
greater than one describe a family of "WEAR OUT" distributions (increasing failure 
rate functions); an a value equal to one describe the "NO WEAR" exponential; and a 
values less than one describe a family of "WEAR IN" distributions (decreasing failure 
rate functions). Consequently, the Weibull distribution provides an additional 
modelling flexibility that should reduce the latter two areas of concern associated with 
the exponential distribution. 

The Weibull cumulative distribution function (Figure 3.3) and the exponential 
quantile-quantile plots indicate that a Weibull model with scale parameter (X > 0) and 
shape parameter (a<l) might provide appropriate descriptors of the failure rate 
distribution for each of the components studied. As mentioned above, a shape 
parameter less than one is indicative of a "WEAR IN" family of distributions. 
Distributions of this type are characterized b\ a hazard rate function. r(t), which is 
decreasing in t, (i.e., the component's failure rate decreases as t increases). Since, the 
majority of components studied are electronic components (AVIONICS), this 
assumption of a decreasing failure rate is probably an improvement over the constant 
failure rate of the exponential model. 

2. Maximum Likelihood Results 

Maximum likelihood solutions can be obtained by setting the partials equal to 
zero, and solving for X' and «' using nonlinear optimization techniques similar to the 
one described in Appendix G. The partial derivatives of the log-likelihood function 
with respect to the parameters X and a are displayed below: 3 




- £(XT j )«log(XT j ) 



3 The derivation of these equations is given in Appendix D. 
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where, a,X>0; T-,tj,Tj ^ 0; i=l,2,...,m (the set of uncensored observations - failures); 
and j = m+ l,m + 2,...,n (the set of censored observations). 

The maximum likelihood estimates for and a' were found using the 
FORTRAN program listed in Appendix G. The parameter estimates and 95 percent 
confidence limits for these estimates are displayed in Table 8. 



TABLE 8 

WEIBULL MAXIMUM LIKELIHOOD RESULTS 



wuc 


r 


CL X 


a' 


CL a 


734H100 


.0149 


(.0084, .0216) 


" .8079 


(.8014, .8146) 


46X1600 


.0044 


(.0006, .0082) 


.6664 


(.6627, .6703) 


4622100 


.0066 


(.0024, .0108) 


.7708 


(.7666, .7750) 


56X2500 


.0119 


(.0063..0176) 


.8170 


(.8114,-8227) 


632Z100 


.0067 


(.0026, .0109) 


.7970 


(.7928, .S011) 


74A1500 


.0165 


• (.0084, .0246) 


.7066 


(.6985,-7147) 


74A5M00 


.0164 


(.0104, .0224) 


.8844 


(.8784, .8904) 


5772200 


.0045 


(.0009..0082) 


.7385 


(.7349-7422) 


6918100 


.0112 


(.0058, .0167)* 


.8142 


(.8087, .8196) 


*** CL = 


95 PERCENT CONFIDENCE LIMITS 





3. Quantile-Quantile Plots 

The parameter estimates listed in Table 8 were used to construct Kaplan- 
Meier quantile-quantile plots for each of the nine components studied. Two of these 
quantile-quantile plots are displayed in Figures 3.4 and 3.5, and the other seven are 
included in Appendix H. Both Figures graphically illustrate that the data is fit well by 
the Weibull distribution, with the worst case fit represented by Figure 3.4. This plot 
shows that the Weibull distribution has a tendency to underestimate the empirical 
quantiles below ten percent, but fits the data extremely well for quantiles greater than 
ten percent. 
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The results of the Weibull quantile-quantile plots are not conclusive, but offer 
credibility to the use of the Weibull model as an alternative method of modelling 
component failure rates when flight time is the only contributing factor. 
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Figure 3.4 Weibull Quantile-Quantile Plot: WUC 7341 1 100. 
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Figure 3.5 Weibull Quantile-Quantile Plot: WUC 56X2500. 



38 



IV. SORTIE DEPENDENT MODELS 



A. OVERVIEW 

The two models that will be discussed in this chapter differ from the models in 
Chapter III in that component failures can be affected by stresses incurred as a result 
of the sortie. 4 These stresses refer to events that occur during each flight, regardless of 
the sortie length, and would include events such as equipment initialization, takeoffs, 
landings, etc. The first sortie-dependent model to be discussed is the Geometric model. 

which determines a constant probability that a component fails on a given sortie. 

% 

The second sortie-dependent model that will be briefly looked at is the Mixed 
model described in reference 5. This model could also be classified as a flight hour 
model since it determines the probability of a component failure based on both sortie 
and flight hour contributing factors. It is incorporated in this section because it also 
utilizes the geometric distribution to determine the probability that the first failure 
occurs -on the s in sortie. The major difference between these two models is that the 
Mixed model's probability of failure for a given sortie is not constant. In fact, it is a 
function of a constant failure probability caused by sortie-related stress, and a 
probability of failure which is dependent on the sortie length. 

B. GEOMETRIC MODEL 

1. Properties 

The basic premise of the Geometric model is that the component failure 
results due to sortie-related stress and is insensitive to differences in sortie length. This 
assumption can then be used to formulate the component's survival or failure for a 
given sortie as a Bernoulli trial, where, the component fails with probability p or 
survives with probability 1-p. The geometric distribution is used to determine the 
probability of observing the first failure on the s^ Bernoulli trial. 

The geometric distribution is in many ways similar to the exponential 
distribution and might be considered the exponential's discrete analog. Like its 
continuous counterpart, the geometric distribution is ''memoryless" and has a constant 
failure rate, which would indicate that the Geometric model also ignores the history of 



4 



A sortie refers to one complete flight evolution, take-off to full-stop landing. 
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